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(54) THREE-DIMENSIONAL IMAGE COMPOSITING DEVICE, ITS METHOD, 
INFORMATION STORAGE MEDIUM PROGRAM DISTRIBUTING DEVICE AND 
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(57)Abstract: 

PROBLEM TO BE SOLVED: To add gradation 
according to distance from a viewpoint to a display 
gi - m*k screen without remarkably increasing processing 

V burden. 

SOLUTION: To which of the closest view 64, a close 
view 62, focus depth 60, a distant view 58 or the most 

.<fl-ox6c?, distant view 56 each pixel belongs is decided based 

...„.,on Z value held in a Z buffer. Alpha values (depth 
&o; ftfcs* t±=QW, range information) corresponding to depth ranges are 
wi'-^Ti-Si^T^"^ 58 ^ m respective pixels. Translucent composition of 
■i4£mii*Hf-6**QT color information of each pixel is performed with 

w color information of other pixels in forms 

^fc*ster* corresponding to the alpha values. For example, the 

translucent composition is performed for an original 
image by shifting prescribed pixels to the left and 
right for the pixels belonging to the distant view 58 
and the most distant view 56. In addition, the 
translucent composition is further performed to the 
original image by shifting up and down by prescribed 
pixels for the pixels belonging to the closet view 56. 
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* NOTICES * 
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damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the 
original precisely. 

2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] Especially this invention relates to the technique of performing far 
and near shading-off processing to a three-dimension image, about a three-dimension image 
synthesizer unit and an approach, an information storage medium, program distribution 
equipment, and an approach. 
[0002] 

[Description of the Prior Art] In a three-dimension image processing, it is projected on the 
perspective-projection side where the object arranged in object space (virtual three-dimension 
space) has been arranged ahead [ view ], and the display output of this projection image is 
carried out by the monitor. The top-most-vertices coordinate (UVW) of each polygon which 
constitutes the object expressed with view system of coordinates from perspective-projection 
processing is **(ed) with U value (depth coordinate). In this way, as the object arranged in 
the distance from the view looks small, depth perception is expressed on the display screen. 
[0003] 

[Problem(s) to be Solved by the Invention] By the above image processing, after the focus of 
the object [ the object arranged in the distance from the view or ] arranged in near has suited 
finely, image display is carried out. However, the focus suits only the object arranged in 
depth of field (depth of focus) which set a diaphragm value as disconnection and took a 
photograph of it, for example, and if it comes to be able to carry out image display in the 
mode from which the focus has separated so that the distance from a focus separates about 
the other object, the width of face of an image expression can increase breadth and the reality 
of a display image. 

[0004] This invention is made in view of the above-mentioned technical problem, and the 
purpose is in offering the three-dimension image synthesizer unit and the three-dimension 
image composition approach of adding the shading off according to the distance from a view 
to a display image, an information storage, program distribution equipment, and the program 
distribution approach, without making a processing burden increase sharply. 
[0005] 

[Means for Solving the Problem] In order to solve the above-mentioned technical problem, 
the three-dimension image synthesizer unit concerning this invention is characterized by 
including a display image storage means to memorize the color information and depth 
information on each pixel which constitute a display image, and the shading-off processing 
means which carries out translucent composition of said color information on each pixel to 
said color information on other pixels in the mode according to said depth information. 
[0006] Moreover, the three-dimension image composition approach concerning this invention 
is characterized by including the step which memorizes the color information and depth 
information on each pixel which constitute a display image, and the step which carries out 
translucent composition of said color information on each pixel to said color information on 
other pixels in the mode according to said depth information. 



[0007] Moreover, the information storage medium concerning this invention stores the 
program for making a computer perform the step which memorizes the color information and 
depth information on each pixel which constitute a display image, and the step which carries 
out translucent composition of said color information on each pixel to said color information 
on other pixels in the mode according to said depth information. 

[0008] Moreover, the program distribution equipment concerning this invention distributes 
the program for making a computer perform the step which memorizes the color information 
and depth information on each pixel which constitute a display image, and the step which 
carries out translucent composition of said color information on each pixel to said color 
information on other pixels in the mode according to said depth information. 
[0009] Moreover, the program distribution approach concerning this invention distributes the 
program for making a computer perform the step which memorizes the color information and 
depth information on each pixel which constitute a display image, and the step which carries 
out translucent composition of said color information on each pixel to said color information 
on other pixels in the mode according to said depth information. 

[0010] By this invention, about each pixel, color information and depth information are 
memorized and translucent composition of the color information on the pixel is carried out to 
the color information on other pixels in the mode according to depth information. Depth 
information is the information in connection with the distance from a view, for example, can 
use well-known Z value etc. Translucent composition is processing which adds 
comparatively to a target the color information on a pixel and the color information on the 
pixel of a composition place which are compounded, for example. If it carries out like this, 
shading-off processing according to the distance from a view can be realized without making 
a processing burden increase sharply. 

[001 1] In one mode of this invention, said shading-off processing means carries out 
translucent composition of said color information on each pixel to the color information on 
other pixels including a depth range information setting means to set depth range information 
as each pixel based on said depth information, in the mode according to said depth range 
information set up by this depth entry means. If it carries out like this, a mode is changed in 
the unit of the depth range and shading-off processing can be performed. 
[0012] In one mode of this invention, moreover, said shading-off processing means The 1st 
pixel decision means which judges whether each pixel is a back side pixel showing the object 
located in a back side rather than the predetermined depth of focus in virtual three-dimension 
space based on said depth information, The 2nd pixel decision means which judges whether 
each pixel is a focal pixel showing the object located in the predetermined depth of focus in 
virtual three-dimension space based on said depth information, About said color information 
on said back side pixel, a translucent composition limit means to restrict carrying out 
translucent composition to said color information on said focal pixel at least is included. If it 
carries out like this, it can control that translucent composition of the color information on a 
back side pixel is carried out, and it turns into color information which is a focal pixel with 
unnatural shading-off processing. 
[0013] 

[Embodiment of the Invention] Hereafter, the gestalt of suitable operation of this invention is 
explained to a detail based on a drawing. 

[0014] Drawing 1 is drawing showing the configuration of the game equipment concerning 1 
operation gestalt of this invention. The game equipment 10 shown in this drawing is one of 
the operation gestalten of the three-dimension image synthesizer unit concerning this 
invention, and is constituted by equipping with the information storage medium slack DVD 
25 the home video game machine 1 1 connected to the monitor 1 8 and the loudspeaker 22. 
Here, although DVD25 is used in order to supply a game program and game data to a home 



video game machine 1 1, all other information storages, such as CD-ROM and a ROM card, 
can be used. Moreover, a game program and game data can also be supplied to a home video 
game machine 1 1 from a remote place through a communication network so that it may 
mention later. Below, the three-dimension image synthesizer unit, the three-dimension image 
composition approach, and information storage medium concerning this invention are 
explained through explanation of this game equipment 10. 

[0015] A microprocessor 14, the image-processing section 16, a primary storage 26, and the 
radial transfer section 30 are connected by the bus 12 possible [ mutual data communication 
], and, as for the home video game machine 1 1, a controller 32, the speech processing section 
20, and the DVD playback section 24 are further connected to the radial transfer section 30. 
Each component of home video game machines 1 1 other than controller 32 is held in the 
case. A television set for home use is used for a monitor 18, and the built-in loudspeaker is 
used for a loudspeaker 22, for example. 

[0016] A microprocessor 14 controls each part of a home video game machine 1 1 based on 
the game program read from the operating system stored in ROM which is not illustrated, or 
DVD25. A bus 12 is for exchanging the address and data in each part of a home video game 
machine 1 1 . Moreover, the game program and game data which were read in DVD25 are 
written in a primary storage 26 if needed. The image-processing section 16 is constituted 
including VRAM, changes the contents into a predetermined video signal, and outputs them 
to a monitor 18 to predetermined timing while it receives the image data sent from a 
microprocessor 14 and draws a game screen on VRAM. That is, the image-processing section 
16 receives a top-most- vertices coordinate (X, Y, Z), top-most- vertices color information (R, 
G, B), a texture coordinate (VX, VY), an alpha value, etc. of each polygon in view system of 
coordinates from a microprocessor 14. And color information, Z value (depth information), 
an alpha value, etc. of each pixel which constitutes a display image using these information 
are drawn to VRAM. This display image is outputted to a monitor 18 to predetermined 
timing. In case a pixel is drawn to VRAM, a pixel test can be performed to arbitration. There 
are an alpha test, a destination alpha test, and a depth test as pixel test. The pixel test of 
arbitration is carried out according to the directions from a microprocessor 14. Among these, 
when an alpha test compares the alpha value and the given criteria alpha value of a drawing 
pixel and it does not satisfy predetermined conditions, drawing of the pixel is restricted. 
When a destination alpha test compares the alpha value (destination alpha value) and 
predetermined value (0x80) of a pixel (pixel already drawn by the drawing place address of 
VRAM) of a drawing place and it does not satisfy predetermined conditions, drawing of the 
pixel is restricted. A depth test compares Z value of a drawing pixel with Z value of Z-uffer 
(prepared for VRAM), and when not satisfying predetermined conditions, drawing of the 
pixel is restricted. Moreover, when drawing a pixel to VRAM, it can mask now and the 
writing to the color information, Z value, and the alpha value of each pixel can be forbidden 
to arbitration. 

[0017] The radial transfer section 30 is an interface for relaying the data communication 
between a controller 32, the speech processing section 20 and the DVD playback section 24, 
and a microprocessor 14. A controller 32 is an input means for a player to carry out game 
actuation. The radial transfer section 30 scans the actuation condition of the various carbon 
buttons of a controller 32 to a fixed period (for example, every [1/60 seconds (every) ]), and 
passes the actuation signal showing the scanning result to a microprocessor 14 through a bus 
12. A microprocessor 14 judges game actuation of a player based on the actuation signal. The 
speech processing section 20 is constituted including the sound buffer, reproduces data which 
were read from DVD25 and memorized by the sound buffer, such as music and a game sound 
effect, and outputs them from a loudspeaker 22. The DVD playback section 24 reads the 
game program and game data which were recorded on DVD25 according to the directions 



from a microprocessor 14. 

[0018] Hereafter, the technique of performing shading-off processing to a game image 
according to the distance from a view is explained using the game equipment 10 which has 
this configuration. 

[0019] Drawing 2 is drawing showing an example of the game image displayed on the 
monitor 18 of game equipment 10. The game image shown in this drawing expresses a part of 
virtual three-dimension space (game space) built on a primary storage 26, the grassy place 
object 44 is expressed near the view, and the vehicle object 40 is expressed to the other side. 
Furthermore, the house object 46 and the crest object 42 are expressed to the other side. 
Among these, according to the game equipment 10 concerning the gestalt of operation of this 
invention, shading-off processing is performed to the grassy place object 44, the house object 
46, and the crest object 42. On the other hand, shading-off processing is not performed to the 
vehicle object 40. Moreover, as for the crest object 42 arranged in the location more distant 
than the house object 46 from a view, dotage becomes large, in this way, it is from other 
objects about this object 40 in the case, using the vehicle object 40 order as the depth of focus 
— it indicates by ******. In addition, the depth of focus is equivalent to the depth of field of a 
camera, and says the range of the direction of a look regarded as the focus suiting practically. 
[0020] Drawing 3 is a flow Fig. explaining the game processing performed with game 
equipment 10. As shown in this drawing, with game equipment 10, a microprocessor 14 
performs game atmospheric control first based on the game program and game data which are 
read from DVD25 (S101). In game atmospheric control, the location and posture of all the 
static objects of virtual three-dimension space and dynamic objects calculate. A static object 
does not change a location, even if a game advances like the grassy place object 44, the crest 
object 42, and house object 46 grade. On the other hand, a dynamic object changes a location 
and a posture as a game advances like the vehicle object 40. The location and posture of a 
dynamic object change according to the actuation signal inputted from a game program or a 
controller 32. Moreover, a view and the visual field range are also calculated in game 
atmospheric control. And about the object which is distant from the visual field range, it is 
excepted from the object of subsequent game processings. 

[0021] Next, a microprocessor 14 performs geometry processing (S102). In geometry 
processing, coordinate transformation from a world coordinate to view system of coordinates 
is performed. Moreover, the color information on the top-most vertices of each polygon 
which constitutes an object is corrected based on light source information (the color and 
location of the light source). Furthermore, clipping processing is also performed. 
[0022] Then, a microprocessor 14 sends out the top-most-vertices coordinate, the top-most- 
vertices color information, texture coordinate, and alpha value of each polygon belonging to 
the visual field range to the image-processing section 16, and forms a display image in the 
input buffer prepared on VRAM based on those information in the image-processing section 
16 (SI 03): Furthermore, in the image-processing section 16, far and near shading-off 
processing is performed according to the directions from a microprocessor 14 (SI 04). The 
game image which finished far and near shading-off processing, and was formed in the 
output buffer of VRAM of the image-processing section 16 is read to predetermined timing, 
and is displayed by the monitor 18. 

[0023] Drawing 4 and drawing 5 are flow Figs, which explain to a detail the far and near 
shading-off processing performed with game equipment 10. In far and near shading-off 
processing, the alpha value (depth range information) of each pixel is set up about the display 
image first formed on VRAM by SI 03 according to the distance (Z value) from a view 
(S201-S205). Drawing 6 is drawing explaining the setting Ruhr of an alpha value. About the 
pixel showing the object arranged recently [ among the objects which belong to the visual 
field range 54 as shown in this drawing ] than Z3 Z value is larger at the view 64 (depth range 



nearest to a view 50), an alpha value is set as OxaO. Moreover, about the pixel showing the 
object arranged at the close-range view 62 (depth range near [ a view 50 ] a degree) whose Z 
value is from Z2 to Z3, an alpha value is set as 0x90. Moreover, about the pixel showing the 
object arranged in the inside of the depth of focus 60 (depth range regarded as seeing from a 
view 50 and the focus suiting practically) whose Z value is from Zl to Z2, an alpha value is 
set as 0x80. Moreover, about the pixel showing the object arranged at the distant view 58 
(immediately the depth range [ Seeing from a view 50. the depth of focus 60 ] of the other 
side) whose Z value is from Z0 to Zl, an alpha value is set as 0x70. Furthermore, about the 
pixel showing the object arranged at the maximum distant view 56 (seeing from a view 50 
most distant depth range) whose Z value is less than [ Z0 ], an alpha value is set as 0x60. As 
Z0-Z3, the value with which Z3>Z2>Z1>Z0 is filled is set up beforehand. 
[0024] For this reason, by far and near shading-off processing, an alpha value is first smeared 
away by OxaO about all pixels (S201). The polygon of the specifically same size as the 
perspective-projection side 52 where OxaO was set as the alpha value is masked and drawn to 
information other than the alpha value of the pixel of a drawing place (color information and 
value of Z-uffer). Next, an alpha value is smeared away by 0x90 about the pixel used as Z3 
>=Z (S202). The polygon of the same size as the perspective-projection side 52 where Z3 
was set as Z value, and 0x90 was specifically further set as the alpha value is masked and 
drawn to information other than the alpha value of the pixel of a drawing place (color 
information and value of Z-uffer). A depth test is used at this time, then — the pixel used as 
Z2 >=Z — an alpha value — 0x80 — an alpha value is smeared away by 0x70 about continuous 
tone (S203) and the pixel continuously set to Zl >=Z, and an alpha value is smeared away by 
0x60 about continuous tone (S204) and the pixel which is further alike and is set to Z0 >=Z 
(S205). The procedure of continuous tone is the same as that of S201. 

[0025] Next, the image on VRAM which set up the alpha value as mentioned above is copied 
on the output buffer in which it was prepared on this VRAM (S206). It writes in an output 
buffer by making into a texture the image (formed on the input buffer of VRAM) specifically 
obtained by S201-S205 in the polygon of the size same on an output buffer as the 
perspective-projection side 52. 

[0026] Next, a microprocessor 14 directs distant view shading-off processing to the image- 
processing section 16 (S207, S208). The pixel showing the object by which distant view 
shading-off processing has been arranged at the distant view 58 and the maximum distant 
view 56 is applicable. Here, an alpha test is carried out among the pixels first drawn by the 
input buffer, it shifts at a time 1 pixel of pixels to which an alpha value belongs to 0x70 or 
less thing 58, i.e., a distant view, and the maximum distant view 56 right and left from the 
original location, and translucent composition is carried out at the image drawn by the output 
buffer (S207). That is, 1 pixel is first shifted on left-hand side, translucent composition is 
carried out, 1 pixel is continuously shifted on right-hand side, and translucent composition is 
carried out. At this time, each rate of translucent sets up the suitable value beforehand so that 
the natural dotage taste may be reproduced. Moreover, a destination alpha test is carried out 
in the case of this translucent composition, and an alpha value is made not to carry out 
translucent composition of the pixel belonging to a distant view 58 and the maximum distant 
view 56 at 0x80 or more pixels. If it carries out like this, it can avoid carrying out translucent 
composition of the pixel belonging to a distant view 58 and the maximum distant view 56 at 
the pixel which belongs to a view 64, a close-range view 62, and the depth of focus 60 
recently, and it can reproduce the natural dotage taste. 

[0027] Then, an alpha test is carried out among the pixels drawn by the input buffer, it shifts 
at a time 1 pixel of pixels to which an alpha value belongs to 0x60 or less thing 56, i.e., the 
maximum distant view, up and down from the original location, and translucent composition 
is carried out at the image drawn by the output buffer (S208). That is, 1 pixel is first shifted to 



the up side, translucent composition is carried out, 1 pixel is continuously shifted to the down 
side, and translucent composition is carried out. Also at this time, the suitable value is 
beforehand set up so that each rate of translucent may reproduce the natural dotage taste. 
Moreover, a destination alpha test is carried out and an alpha value is made not to carry out 
translucent composition of the pixel belonging to the maximum distant view 56 at 0x80 or 
more pixels. 

[0028] In this way, translucent composition which it shifted 1 pixel at a time right and left 
about the pixel belonging to a distant view 58 and the maximum distant view 56 can be 
carried out, and translucent composition which it shifted 1 pixel at a time also to the upper 
and lower sides further can be carried out about the pixel belonging to the maximum distant 
view 56. In this way, dotage of the pixel which belongs to the maximum distant view 56 
compared with a distant view 58 can be enlarged. 

[0029] Then, a microprocessor 14 directs close-range view shading-off processing to the 
image-processing section 16 (S209, S210). The pixel showing the object by which close- 
range view shading-off processing has been arranged a close-range view 62 and recently at 
the view 64 is applicable. Here, an alpha test is carried out among the pixels first drawn by 
the input buffer, it shifts at a time 1 pixel of pixels to which an alpha value belongs to a view 
64 0x90 or more things 62, i.e., a close-range view, and recently right and left from the 
original location, and translucent composition is carried out at the image drawn by the output 
buffer (S209). That is, 1 pixel is first shifted on left-hand side, translucent composition is 
carried out, 1 pixel is continuously shifted on right-hand side, and translucent composition is 
carried out. At this time, each rate of translucent sets up the suitable value beforehand so that 
the natural dotage taste may be reproduced. 

[0030] Then, an alpha test is carried out among the pixels drawn by the input buffer, an alpha 
value shifts at a time 1 pixel of zero or more 0xa(s) things, i.e., the pixel to which it belongs 
to a view 64 recently, up and down from the original location, and translucent composition is 
carried out at the image drawn by the output buffer (S210). That is, 1 pixel is first shifted to 
the up side, translucent composition is carried out, 1 pixel is continuously shifted to the down 
side, and translucent composition is carried out. Also at this time, the suitable value is 
beforehand set up so that each rate of translucent may reproduce the natural dotage taste. 
[0031] In this way, translucent composition which it shifted 1 pixel at a time right and left 
about the pixel which belongs to a view 64 a close-range view 62 and recently can be carried 
out, and translucent composition which it shifted 1 pixel at a time also to the upper and lower 
sides further can be carried out about the pixel which belongs to a view 64 recently. In this 
way, dotage of the pixel which belongs to a view 64 recently compared with a close-range 
view 62 can be enlarged. 

[0032] Then, the image drawn by the buffer for an output is supplied to a monitor 18 to 
predetermined timing, and image display is performed there. 

[0033] According to the game equipment 10 explained above, shading-off processing cannot 
be carried out about the pixel belonging to the depth of focus 60, but shading-off processing 
can be carried out according to the detached building condition from the depth of focus about 
the other pixel. That is, as it goes to a back side from the depth of focus 60, dotage becomes 
large, and dotage becomes larger as it comes to a near side from the depth of focus 60. 
moreover, since the translucent composition of the pixel which carries out a destination alpha 
test and belongs to a distant view 58 and the maximum distant view 56 is made not to be 
carried out at the pixel belonging to the near side, it is about the pixel belonging to the depth 
of focus 60 in the case — it can consider as **** and natural shading-off processing. 
[0034] In addition, this invention is not limited to the gestalt of the above operation. 
[0035] For example, although the translucent composition of the pixel which carries out a 
destination alpha test and belongs to a distant view 58 and the maximum distant view 56 was 



made not to be carried out at the pixel belonging to the near side, especially the depth of 
focus 60 in the above explanation, it may be made to carry out overwrite drawing of the pixel 
which belongs to the depth of focus 60 among the images with which it was formed on the 
input buffer at the correspondence pixel of the image formed on the output buffer instead of 
carrying out a destination alpha test. 

[0036] Moreover, you may make it dotage become large, although the count and direction of 
translucent composition are changed by the distant view 58 and the maximum distant view 56 
and dotage of the maximum distant view 56 is enlarged in the above explanation, so that the 
rate of translucent is changed or it separates from the depth of focus 60 by changing the 
amount of gaps of the pixel at the time of carrying out translucent composition. The same is 
said of the case of a view 64 a close-range view 62 and recently. That is, the natural dotage 
taste is realizable by carrying out translucent composition in the mode which changed various 
parameters, such as the amount of gaps of the mode according to Z value, i.e., the count of 
translucent composition, a direction, the rate of translucent, and a pixel, according to Z value. 
[0037] Moreover, although the above explanation is a thing about an example which carries 
out this invention using a home video game machine 11, this invention is applicable to 
business-use game equipment similarly. In this case, it is desirable to replace with DVD25 
and the DVD playback section 24, and to also form a monitor 18 and a loudspeaker 22 in one 
using more nearly high-speed storage. 

[0038] Moreover, although DVD25 which stored a game program and game data was used 
with the home video game machine 1 1 in the above explanation, the information storage 
which recorded a game program and game data, such as a personal computer, is read, and 
anythings can be used if it is the computer for which information can be processed based on 
the read contents. 

[0039] Moreover, this invention is applicable not only to the image processing in connection 
with a game but all three-dimension image processings. For example, this invention is 
applicable to three-dimension CG animation, a flight simulator, a drive simulator, etc. 
[0040] Furthermore, although a game program and game data were supplied to the home 
video game machine 1 1 from the information storage slack DVD 25 in the above explanation, 
a game program and game data can also be distributed to a home etc. through a 
communication network. Drawing 7 is drawing showing the whole game program 
distribution system configuration which used the communication network. The program 
distribution equipment and the approach of starting this invention based on this drawing are 
explained. As shown in this drawing, this game program distribution system 100 contains the 
game database 102, a server 104, a communication network 106, a personal computer 108, a 
home video game machine 110, and PDA (Personal Digital Assistant) 1 12. Among these, 
game program distribution equipment 1 14 is constituted by the game database 102 and the 
server 104. Communication networks 106 are the Internet and a cable television network. In 
this system, the same game program as the contents of storage and game data of DVD25 are 
memorized by the game database 102. And when a need person does a game distribution 
demand using a personal computer 108, a home video game machine 1 10, or PDA1 12 grade, 
it is told to a server 104 through a communication network 106. And a server 104 reads a 
game program and game data from the game database 102 according to a game distribution 
demand, and transmits it to personal computer 108, home video game machine 1 10 or 
PDA1 12 grade, and game distribution demand origin. Although it was made to carry out 
game distribution here according to the game distribution demand, you may make it transmit 
to a target on the other hand from a server 104. Moreover, it is not necessary to distribute all 
the game programs required for implementation and game data of a game not necessarily at 
once, and you may make it distribute a required part according to the aspect of affairs of a 
game. Thus, if it is made to carry out game distribution through a communication network 



106, a game program and game data can come to hand [ a need person ] easily. 
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